Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ci: set job status of e2e tests to passed after 15m timeout #6017

Merged
merged 4 commits into from
Oct 3, 2023
Merged

ci: set job status of e2e tests to passed after 15m timeout #6017

merged 4 commits into from
Oct 3, 2023

Conversation

nflaig
Copy link
Member

@nflaig nflaig commented Oct 3, 2023 •
edited
Loading

Motivation

Closes #5913

Description

E2E tests are sometimes stalling until timeout (6 hours) is reached but we know that after 15 minutes those should have passed already if there are no failed test cases. In this case, just set the job status to passed as there was likely no actual issue.

Scenario Job status
all tests pass early ✔️
after 15m timeout ✔️
any test case fails ❌

Regarding the formatting changes, there were a lot of extra white spaces for no good reason, diff comes from auto-formatting.

@nflaig nflaig requested a review from a team as a code owner October 3, 2023 11:17
nazarhussain
nazarhussain requested changes Oct 3, 2023
View reviewed changes
.github/workflows/test.yml Outdated Show resolved Hide resolved
@nflaig nflaig marked this pull request as draft October 3, 2023 11:46
@github-actions
Copy link
Contributor

github-actions bot commented Oct 3, 2023 •
edited
Loading

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: c265fa7 Previous: d9e6f1a Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 617.43 us/op 1.0370 ms/op 0.60
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 116.50 us/op 111.20 us/op 1.05
BLS verify - blst-native 1.5808 ms/op 1.1894 ms/op 1.33
BLS verifyMultipleSignatures 3 - blst-native 3.0624 ms/op 2.4652 ms/op 1.24
BLS verifyMultipleSignatures 8 - blst-native 6.5709 ms/op 5.4421 ms/op 1.21
BLS verifyMultipleSignatures 32 - blst-native 31.202 ms/op 19.976 ms/op 1.56
BLS verifyMultipleSignatures 64 - blst-native 48.193 ms/op 39.397 ms/op 1.22
BLS verifyMultipleSignatures 128 - blst-native 106.57 ms/op 78.224 ms/op 1.36
BLS deserializing 10000 signatures 1.0307 s/op 904.09 ms/op 1.14
BLS deserializing 100000 signatures 9.1441 s/op 9.2689 s/op 0.99
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.3706 ms/op 1.1881 ms/op 1.15
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.5673 ms/op 1.3643 ms/op 1.15
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.4368 ms/op 3.0808 ms/op 0.79
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.5719 ms/op 3.4257 ms/op 1.04
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.8044 ms/op 7.3582 ms/op 0.79
BLS aggregatePubkeys 32 - blst-native 26.545 us/op 30.677 us/op 0.87
BLS aggregatePubkeys 128 - blst-native 103.82 us/op 91.533 us/op 1.13
getAttestationsForBlock 45.021 ms/op 70.101 ms/op 0.64
isKnown best case - 1 super set check 327.00 ns/op 487.00 ns/op 0.67
isKnown normal case - 2 super set checks 323.00 ns/op 263.00 ns/op 1.23
isKnown worse case - 16 super set checks 368.00 ns/op 305.00 ns/op 1.21
CheckpointStateCache - add get delete 5.8050 us/op 6.3780 us/op 0.91
validate api signedAggregateAndProof - struct 2.8479 ms/op 2.5318 ms/op 1.12
validate gossip signedAggregateAndProof - struct 2.8447 ms/op 2.5136 ms/op 1.13
validate gossip attestation - vc 640000 1.4061 ms/op 1.2824 ms/op 1.10
batch validate gossip attestation - vc 640000 - chunk 32 169.16 us/op 203.54 us/op 0.83
batch validate gossip attestation - vc 640000 - chunk 64 153.23 us/op 190.42 us/op 0.80
batch validate gossip attestation - vc 640000 - chunk 128 139.35 us/op 172.69 us/op 0.81
batch validate gossip attestation - vc 640000 - chunk 256 132.88 us/op 172.43 us/op 0.77
pickEth1Vote - no votes 1.3199 ms/op 1.4603 ms/op 0.90
pickEth1Vote - max votes 9.5107 ms/op 19.626 ms/op 0.48
pickEth1Vote - Eth1Data hashTreeRoot value x2048 16.413 ms/op 29.048 ms/op 0.57
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 20.270 ms/op 50.988 ms/op 0.40
pickEth1Vote - Eth1Data fastSerialize value x2048 574.23 us/op 627.51 us/op 0.92
pickEth1Vote - Eth1Data fastSerialize tree x2048 4.1559 ms/op 11.133 ms/op 0.37
bytes32 toHexString 469.00 ns/op 764.00 ns/op 0.61
bytes32 Buffer.toString(hex) 290.00 ns/op 406.00 ns/op 0.71
bytes32 Buffer.toString(hex) from Uint8Array 429.00 ns/op 849.00 ns/op 0.51
bytes32 Buffer.toString(hex) + 0x 294.00 ns/op 416.00 ns/op 0.71
Object access 1 prop 0.15300 ns/op 0.25400 ns/op 0.60
Map access 1 prop 0.15200 ns/op 0.19200 ns/op 0.79
Object get x1000 6.9960 ns/op 5.4290 ns/op 1.29
Map get x1000 0.58200 ns/op 0.70400 ns/op 0.83
Object set x1000 48.220 ns/op 28.495 ns/op 1.69
Map set x1000 38.343 ns/op 19.154 ns/op 2.00
Return object 10000 times 0.23690 ns/op 0.27670 ns/op 0.86
Throw Error 10000 times 3.8803 us/op 5.4888 us/op 0.71
fastMsgIdFn sha256 / 200 bytes 3.2900 us/op 4.4790 us/op 0.73
fastMsgIdFn h32 xxhash / 200 bytes 279.00 ns/op 376.00 ns/op 0.74
fastMsgIdFn h64 xxhash / 200 bytes 345.00 ns/op 449.00 ns/op 0.77
fastMsgIdFn sha256 / 1000 bytes 11.530 us/op 12.060 us/op 0.96
fastMsgIdFn h32 xxhash / 1000 bytes 403.00 ns/op 604.00 ns/op 0.67
fastMsgIdFn h64 xxhash / 1000 bytes 417.00 ns/op 597.00 ns/op 0.70
fastMsgIdFn sha256 / 10000 bytes 105.53 us/op 60.570 us/op 1.74
fastMsgIdFn h32 xxhash / 10000 bytes 1.9480 us/op 2.3700 us/op 0.82
fastMsgIdFn h64 xxhash / 10000 bytes 1.3340 us/op 1.8620 us/op 0.72
send data - 1000 256B messages 18.333 ms/op 29.929 ms/op 0.61
send data - 1000 512B messages 27.585 ms/op 35.456 ms/op 0.78
send data - 1000 1024B messages 41.900 ms/op 45.341 ms/op 0.92
send data - 1000 1200B messages 31.033 ms/op 46.393 ms/op 0.67
send data - 1000 2048B messages 30.167 ms/op 50.809 ms/op 0.59
send data - 1000 4096B messages 26.192 ms/op 55.657 ms/op 0.47
send data - 1000 16384B messages 73.791 ms/op 173.20 ms/op 0.43
send data - 1000 65536B messages 283.18 ms/op 684.42 ms/op 0.41
enrSubnets - fastDeserialize 64 bits 1.3620 us/op 1.8720 us/op 0.73
enrSubnets - ssz BitVector 64 bits 496.00 ns/op 1.2470 us/op 0.40
enrSubnets - fastDeserialize 4 bits 191.00 ns/op 344.00 ns/op 0.56
enrSubnets - ssz BitVector 4 bits 430.00 ns/op 804.00 ns/op 0.53
prioritizePeers score -10:0 att 32-0.1 sync 2-0 104.25 us/op 212.89 us/op 0.49
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 135.96 us/op 221.75 us/op 0.61
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 165.93 us/op 288.36 us/op 0.58
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 295.10 us/op 431.27 us/op 0.68
prioritizePeers score 0:0 att 64-1 sync 4-1 352.29 us/op 483.10 us/op 0.73
array of 16000 items push then shift 1.6578 us/op 1.4851 us/op 1.12
LinkedList of 16000 items push then shift 9.1090 ns/op 10.032 ns/op 0.91
array of 16000 items push then pop 94.641 ns/op 131.27 ns/op 0.72
LinkedList of 16000 items push then pop 8.9810 ns/op 9.7130 ns/op 0.92
array of 24000 items push then shift 2.5763 us/op 2.3179 us/op 1.11
LinkedList of 24000 items push then shift 9.7600 ns/op 18.616 ns/op 0.52
array of 24000 items push then pop 132.22 ns/op 243.51 ns/op 0.54
LinkedList of 24000 items push then pop 9.1840 ns/op 24.741 ns/op 0.37
intersect bitArray bitLen 8 7.8100 ns/op 5.5000 ns/op 1.42
intersect array and set length 8 77.251 ns/op 84.234 ns/op 0.92
intersect bitArray bitLen 128 36.636 ns/op 25.725 ns/op 1.42
intersect array and set length 128 1.0061 us/op 1.6031 us/op 0.63
bitArray.getTrueBitIndexes() bitLen 128 1.7070 us/op 3.9820 us/op 0.43
bitArray.getTrueBitIndexes() bitLen 248 2.7910 us/op 6.2040 us/op 0.45
bitArray.getTrueBitIndexes() bitLen 512 5.3670 us/op 11.142 us/op 0.48
Buffer.concat 32 items 1.0310 us/op 2.1620 us/op 0.48
Uint8Array.set 32 items 1.8310 us/op 4.0490 us/op 0.45
Set add up to 64 items then delete first 4.6577 us/op 3.7818 us/op 1.23
OrderedSet add up to 64 items then delete first 6.1136 us/op 5.6456 us/op 1.08
Set add up to 64 items then delete last 5.0843 us/op 3.9542 us/op 1.29
OrderedSet add up to 64 items then delete last 6.3642 us/op 6.2456 us/op 1.02
Set add up to 64 items then delete middle 4.9996 us/op 4.1000 us/op 1.22
OrderedSet add up to 64 items then delete middle 7.9247 us/op 8.0765 us/op 0.98
Set add up to 128 items then delete first 10.141 us/op 8.0485 us/op 1.26
OrderedSet add up to 128 items then delete first 13.204 us/op 10.644 us/op 1.24
Set add up to 128 items then delete last 9.6467 us/op 6.0660 us/op 1.59
OrderedSet add up to 128 items then delete last 13.578 us/op 9.6291 us/op 1.41
Set add up to 128 items then delete middle 10.345 us/op 6.2474 us/op 1.66
OrderedSet add up to 128 items then delete middle 18.547 us/op 16.891 us/op 1.10
Set add up to 256 items then delete first 20.593 us/op 12.570 us/op 1.64
OrderedSet add up to 256 items then delete first 26.959 us/op 17.650 us/op 1.53
Set add up to 256 items then delete last 20.264 us/op 11.488 us/op 1.76
OrderedSet add up to 256 items then delete last 25.576 us/op 17.511 us/op 1.46
Set add up to 256 items then delete middle 19.309 us/op 11.671 us/op 1.65
OrderedSet add up to 256 items then delete middle 48.583 us/op 33.850 us/op 1.44
transfer serialized Status (84 B) 1.9940 us/op 3.6270 us/op 0.55
copy serialized Status (84 B) 1.6470 us/op 3.1740 us/op 0.52
transfer serialized SignedVoluntaryExit (112 B) 2.0200 us/op 3.5790 us/op 0.56
copy serialized SignedVoluntaryExit (112 B) 1.6680 us/op 3.2600 us/op 0.51
transfer serialized ProposerSlashing (416 B) 2.3540 us/op 4.1960 us/op 0.56
copy serialized ProposerSlashing (416 B) 2.0660 us/op 4.3170 us/op 0.48
transfer serialized Attestation (485 B) 2.0680 us/op 4.1580 us/op 0.50
copy serialized Attestation (485 B) 1.9690 us/op 4.1310 us/op 0.48
transfer serialized AttesterSlashing (33232 B) 2.1500 us/op 2.2970 us/op 0.94
copy serialized AttesterSlashing (33232 B) 6.0560 us/op 6.6880 us/op 0.91
transfer serialized Small SignedBeaconBlock (128000 B) 2.7890 us/op 1.9920 us/op 1.40
copy serialized Small SignedBeaconBlock (128000 B) 16.032 us/op 13.171 us/op 1.22
transfer serialized Avg SignedBeaconBlock (200000 B) 3.1120 us/op 2.6620 us/op 1.17
copy serialized Avg SignedBeaconBlock (200000 B) 21.901 us/op 21.312 us/op 1.03
transfer serialized BlobsSidecar (524380 B) 3.5010 us/op 4.1640 us/op 0.84
copy serialized BlobsSidecar (524380 B) 84.058 us/op 147.20 us/op 0.57
transfer serialized Big SignedBeaconBlock (1000000 B) 3.5150 us/op 4.7750 us/op 0.74
copy serialized Big SignedBeaconBlock (1000000 B) 171.85 us/op 415.81 us/op 0.41
pass gossip attestations to forkchoice per slot 4.0022 ms/op 5.5736 ms/op 0.72
forkChoice updateHead vc 100000 bc 64 eq 0 686.48 us/op 639.59 us/op 1.07
forkChoice updateHead vc 600000 bc 64 eq 0 5.2981 ms/op 6.9379 ms/op 0.76
forkChoice updateHead vc 1000000 bc 64 eq 0 7.6674 ms/op 11.830 ms/op 0.65
forkChoice updateHead vc 600000 bc 320 eq 0 4.7818 ms/op 5.1886 ms/op 0.92
forkChoice updateHead vc 600000 bc 1200 eq 0 4.6889 ms/op 6.3229 ms/op 0.74
forkChoice updateHead vc 600000 bc 7200 eq 0 6.2394 ms/op 8.9528 ms/op 0.70
forkChoice updateHead vc 600000 bc 64 eq 1000 11.996 ms/op 18.709 ms/op 0.64
forkChoice updateHead vc 600000 bc 64 eq 10000 13.347 ms/op 18.704 ms/op 0.71
forkChoice updateHead vc 600000 bc 64 eq 300000 31.275 ms/op 80.977 ms/op 0.39
computeDeltas 500000 validators 300 proto nodes 6.7814 ms/op 6.1783 ms/op 1.10
computeDeltas 500000 validators 1200 proto nodes 6.6131 ms/op 6.4690 ms/op 1.02
computeDeltas 500000 validators 7200 proto nodes 6.5501 ms/op 6.9235 ms/op 0.95
computeDeltas 750000 validators 300 proto nodes 10.248 ms/op 10.489 ms/op 0.98
computeDeltas 750000 validators 1200 proto nodes 9.8765 ms/op 10.250 ms/op 0.96
computeDeltas 750000 validators 7200 proto nodes 9.9132 ms/op 10.288 ms/op 0.96
computeDeltas 1400000 validators 300 proto nodes 20.950 ms/op 19.490 ms/op 1.07
computeDeltas 1400000 validators 1200 proto nodes 19.672 ms/op 19.208 ms/op 1.02
computeDeltas 1400000 validators 7200 proto nodes 19.215 ms/op 20.167 ms/op 0.95
computeDeltas 2100000 validators 300 proto nodes 28.821 ms/op 29.310 ms/op 0.98
computeDeltas 2100000 validators 1200 proto nodes 27.725 ms/op 31.450 ms/op 0.88
computeDeltas 2100000 validators 7200 proto nodes 27.590 ms/op 25.857 ms/op 1.07
computeProposerBoostScoreFromBalances 500000 validators 3.2919 ms/op 2.8040 ms/op 1.17
computeProposerBoostScoreFromBalances 750000 validators 3.2314 ms/op 2.8069 ms/op 1.15
computeProposerBoostScoreFromBalances 1400000 validators 3.3252 ms/op 2.8015 ms/op 1.19
computeProposerBoostScoreFromBalances 2100000 validators 3.4090 ms/op 2.8262 ms/op 1.21
altair processAttestation - 250000 vs - 7PWei normalcase 2.5766 ms/op 3.6333 ms/op 0.71
altair processAttestation - 250000 vs - 7PWei worstcase 3.2442 ms/op 4.7678 ms/op 0.68
altair processAttestation - setStatus - 1/6 committees join 147.51 us/op 180.06 us/op 0.82
altair processAttestation - setStatus - 1/3 committees join 296.29 us/op 396.81 us/op 0.75
altair processAttestation - setStatus - 1/2 committees join 382.92 us/op 524.80 us/op 0.73
altair processAttestation - setStatus - 2/3 committees join 496.49 us/op 691.94 us/op 0.72
altair processAttestation - setStatus - 4/5 committees join 742.95 us/op 965.82 us/op 0.77
altair processAttestation - setStatus - 100% committees join 863.26 us/op 1.2002 ms/op 0.72
altair processBlock - 250000 vs - 7PWei normalcase 7.3245 ms/op 11.749 ms/op 0.62
altair processBlock - 250000 vs - 7PWei normalcase hashState 30.239 ms/op 51.729 ms/op 0.58
altair processBlock - 250000 vs - 7PWei worstcase 40.083 ms/op 46.054 ms/op 0.87
altair processBlock - 250000 vs - 7PWei worstcase hashState 93.315 ms/op 127.47 ms/op 0.73
phase0 processBlock - 250000 vs - 7PWei normalcase 3.0408 ms/op 3.9266 ms/op 0.77
phase0 processBlock - 250000 vs - 7PWei worstcase 34.351 ms/op 33.986 ms/op 1.01
altair processEth1Data - 250000 vs - 7PWei normalcase 658.63 us/op 548.86 us/op 1.20
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 10.330 us/op 20.645 us/op 0.50
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 81.579 us/op 103.47 us/op 0.79
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 29.800 us/op 33.678 us/op 0.88
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 18.462 us/op 16.728 us/op 1.10
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 213.18 us/op 285.57 us/op 0.75
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.4827 ms/op 1.3398 ms/op 1.11
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.9914 ms/op 2.2143 ms/op 0.90
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.6499 ms/op 1.1348 ms/op 1.45
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 4.1305 ms/op 3.1455 ms/op 1.31
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.8067 ms/op 2.7349 ms/op 1.03
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 6.4213 ms/op 8.1323 ms/op 0.79
Tree 40 250000 create 449.46 ms/op 410.42 ms/op 1.10
Tree 40 250000 get(125000) 213.43 ns/op 185.83 ns/op 1.15
Tree 40 250000 set(125000) 1.0641 us/op 1.0764 us/op 0.99
Tree 40 250000 toArray() 22.795 ms/op 29.984 ms/op 0.76
Tree 40 250000 iterate all - toArray() + loop 23.234 ms/op 30.299 ms/op 0.77
Tree 40 250000 iterate all - get(i) 75.702 ms/op 77.639 ms/op 0.98
MutableVector 250000 create 12.637 ms/op 20.802 ms/op 0.61
MutableVector 250000 get(125000) 6.7270 ns/op 10.182 ns/op 0.66
MutableVector 250000 set(125000) 267.84 ns/op 319.78 ns/op 0.84
MutableVector 250000 toArray() 3.7806 ms/op 3.3394 ms/op 1.13
MutableVector 250000 iterate all - toArray() + loop 3.7685 ms/op 3.6887 ms/op 1.02
MutableVector 250000 iterate all - get(i) 1.5699 ms/op 1.3311 ms/op 1.18
Array 250000 create 3.3835 ms/op 3.4995 ms/op 0.97
Array 250000 clone - spread 1.0877 ms/op 1.4096 ms/op 0.77
Array 250000 get(125000) 0.55200 ns/op 0.43900 ns/op 1.26
Array 250000 set(125000) 0.70300 ns/op 0.49700 ns/op 1.41
Array 250000 iterate all - loop 88.642 us/op 73.472 us/op 1.21
effectiveBalanceIncrements clone Uint8Array 300000 39.455 us/op 27.430 us/op 1.44
effectiveBalanceIncrements clone MutableVector 300000 324.00 ns/op 231.00 ns/op 1.40
effectiveBalanceIncrements rw all Uint8Array 300000 185.46 us/op 162.23 us/op 1.14
effectiveBalanceIncrements rw all MutableVector 300000 90.865 ms/op 70.268 ms/op 1.29
phase0 afterProcessEpoch - 250000 vs - 7PWei 118.81 ms/op 104.35 ms/op 1.14
phase0 beforeProcessEpoch - 250000 vs - 7PWei 41.963 ms/op 67.154 ms/op 0.62
altair processEpoch - mainnet_e81889 490.43 ms/op 725.28 ms/op 0.68
mainnet_e81889 - altair beforeProcessEpoch 70.002 ms/op 101.17 ms/op 0.69
mainnet_e81889 - altair processJustificationAndFinalization 16.248 us/op 21.423 us/op 0.76
mainnet_e81889 - altair processInactivityUpdates 6.9785 ms/op 12.570 ms/op 0.56
mainnet_e81889 - altair processRewardsAndPenalties 65.817 ms/op 114.84 ms/op 0.57
mainnet_e81889 - altair processRegistryUpdates 6.9100 us/op 3.1570 us/op 2.19
mainnet_e81889 - altair processSlashings 642.00 ns/op 787.00 ns/op 0.82
mainnet_e81889 - altair processEth1DataReset 885.00 ns/op 919.00 ns/op 0.96
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.2855 ms/op 1.4943 ms/op 0.86
mainnet_e81889 - altair processSlashingsReset 4.2490 us/op 4.2260 us/op 1.01
mainnet_e81889 - altair processRandaoMixesReset 4.2350 us/op 8.7620 us/op 0.48
mainnet_e81889 - altair processHistoricalRootsUpdate 608.00 ns/op 984.00 ns/op 0.62
mainnet_e81889 - altair processParticipationFlagUpdates 2.9120 us/op 4.6100 us/op 0.63
mainnet_e81889 - altair processSyncCommitteeUpdates 572.00 ns/op 880.00 ns/op 0.65
mainnet_e81889 - altair afterProcessEpoch 128.20 ms/op 147.43 ms/op 0.87
capella processEpoch - mainnet_e217614 1.5148 s/op 2.5528 s/op 0.59
mainnet_e217614 - capella beforeProcessEpoch 251.79 ms/op 438.28 ms/op 0.57
mainnet_e217614 - capella processJustificationAndFinalization 15.197 us/op 24.867 us/op 0.61
mainnet_e217614 - capella processInactivityUpdates 21.321 ms/op 42.011 ms/op 0.51
mainnet_e217614 - capella processRewardsAndPenalties 269.37 ms/op 447.29 ms/op 0.60
mainnet_e217614 - capella processRegistryUpdates 21.579 us/op 34.310 us/op 0.63
mainnet_e217614 - capella processSlashings 582.00 ns/op 790.00 ns/op 0.74
mainnet_e217614 - capella processEth1DataReset 672.00 ns/op 1.4870 us/op 0.45
mainnet_e217614 - capella processEffectiveBalanceUpdates 4.4705 ms/op 5.9000 ms/op 0.76
mainnet_e217614 - capella processSlashingsReset 2.7600 us/op 5.7910 us/op 0.48
mainnet_e217614 - capella processRandaoMixesReset 4.9030 us/op 8.7230 us/op 0.56
mainnet_e217614 - capella processHistoricalRootsUpdate 706.00 ns/op 1.4260 us/op 0.50
mainnet_e217614 - capella processParticipationFlagUpdates 1.8710 us/op 4.1110 us/op 0.46
mainnet_e217614 - capella afterProcessEpoch 307.96 ms/op 248.93 ms/op 1.24
phase0 processEpoch - mainnet_e58758 475.71 ms/op 814.02 ms/op 0.58
mainnet_e58758 - phase0 beforeProcessEpoch 137.83 ms/op 210.09 ms/op 0.66
mainnet_e58758 - phase0 processJustificationAndFinalization 16.240 us/op 26.494 us/op 0.61
mainnet_e58758 - phase0 processRewardsAndPenalties 63.381 ms/op 96.749 ms/op 0.66
mainnet_e58758 - phase0 processRegistryUpdates 9.4830 us/op 17.456 us/op 0.54
mainnet_e58758 - phase0 processSlashings 606.00 ns/op 821.00 ns/op 0.74
mainnet_e58758 - phase0 processEth1DataReset 478.00 ns/op 1.2760 us/op 0.37
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.0281 ms/op 1.2766 ms/op 0.81
mainnet_e58758 - phase0 processSlashingsReset 2.3310 us/op 5.6920 us/op 0.41
mainnet_e58758 - phase0 processRandaoMixesReset 3.8370 us/op 8.5780 us/op 0.45
mainnet_e58758 - phase0 processHistoricalRootsUpdate 401.00 ns/op 1.1460 us/op 0.35
mainnet_e58758 - phase0 processParticipationRecordUpdates 3.4920 us/op 15.373 us/op 0.23
mainnet_e58758 - phase0 afterProcessEpoch 99.825 ms/op 88.361 ms/op 1.13
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.3390 ms/op 934.60 us/op 1.43
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.6854 ms/op 1.1431 ms/op 1.47
altair processInactivityUpdates - 250000 normalcase 18.313 ms/op 30.402 ms/op 0.60
altair processInactivityUpdates - 250000 worstcase 18.179 ms/op 20.208 ms/op 0.90
phase0 processRegistryUpdates - 250000 normalcase 13.379 us/op 14.476 us/op 0.92
phase0 processRegistryUpdates - 250000 badcase_full_deposits 370.35 us/op 387.77 us/op 0.96
phase0 processRegistryUpdates - 250000 worstcase 0.5 137.75 ms/op 184.43 ms/op 0.75
altair processRewardsAndPenalties - 250000 normalcase 62.148 ms/op 56.389 ms/op 1.10
altair processRewardsAndPenalties - 250000 worstcase 62.332 ms/op 75.308 ms/op 0.83
phase0 getAttestationDeltas - 250000 normalcase 7.9381 ms/op 11.961 ms/op 0.66
phase0 getAttestationDeltas - 250000 worstcase 7.9039 ms/op 7.1969 ms/op 1.10
phase0 processSlashings - 250000 worstcase 2.3751 ms/op 1.9307 ms/op 1.23
altair processSyncCommitteeUpdates - 250000 156.38 ms/op 212.77 ms/op 0.73
BeaconState.hashTreeRoot - No change 330.00 ns/op 541.00 ns/op 0.61
BeaconState.hashTreeRoot - 1 full validator 156.81 us/op 237.01 us/op 0.66
BeaconState.hashTreeRoot - 32 full validator 1.4700 ms/op 3.1554 ms/op 0.47
BeaconState.hashTreeRoot - 512 full validator 15.876 ms/op 37.344 ms/op 0.43
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 163.68 us/op 355.89 us/op 0.46
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.1552 ms/op 5.4654 ms/op 0.39
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 25.069 ms/op 58.754 ms/op 0.43
BeaconState.hashTreeRoot - 1 balances 114.00 us/op 230.95 us/op 0.49
BeaconState.hashTreeRoot - 32 balances 1.3896 ms/op 2.0324 ms/op 0.68
BeaconState.hashTreeRoot - 512 balances 11.863 ms/op 20.755 ms/op 0.57
BeaconState.hashTreeRoot - 250000 balances 198.45 ms/op 446.82 ms/op 0.44
aggregationBits - 2048 els - zipIndexesInBitList 16.225 us/op 21.125 us/op 0.77
regular array get 100000 times 33.771 us/op 30.140 us/op 1.12
wrappedArray get 100000 times 45.191 us/op 29.981 us/op 1.51
arrayWithProxy get 100000 times 15.907 ms/op 18.802 ms/op 0.85
ssz.Root.equals 217.00 ns/op 182.00 ns/op 1.19
byteArrayEquals 224.00 ns/op 190.00 ns/op 1.18
shuffle list - 16384 els 7.4179 ms/op 6.2447 ms/op 1.19
shuffle list - 250000 els 105.91 ms/op 84.052 ms/op 1.26
processSlot - 1 slots 16.496 us/op 34.732 us/op 0.47
processSlot - 32 slots 3.2231 ms/op 4.4627 ms/op 0.72
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 58.813 ms/op 90.259 ms/op 0.65
getCommitteeAssignments - req 1 vs - 250000 vc 2.7396 ms/op 2.1864 ms/op 1.25
getCommitteeAssignments - req 100 vs - 250000 vc 4.0310 ms/op 3.5744 ms/op 1.13
getCommitteeAssignments - req 1000 vs - 250000 vc 4.5521 ms/op 4.0156 ms/op 1.13
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.6000 ns/op 3.9200 ns/op 1.43
state getBlockRootAtSlot - 250000 vs - 7PWei 718.97 ns/op 975.82 ns/op 0.74
computeProposers - vc 250000 10.647 ms/op 10.376 ms/op 1.03
computeEpochShuffling - vc 250000 128.10 ms/op 79.731 ms/op 1.61
getNextSyncCommittee - vc 250000 180.41 ms/op 114.27 ms/op 1.58
computeSigningRoot for AttestationData 36.736 us/op 16.310 us/op 2.25
hash AttestationData serialized data then Buffer.toString(base64) 2.7425 us/op 1.2235 us/op 2.24
toHexString serialized data 1.6383 us/op 802.90 ns/op 2.04
Buffer.toString(base64) 293.25 ns/op 190.69 ns/op 1.54

by benchmarkbot/action

@nflaig nflaig marked this pull request as ready for review October 3, 2023 13:22
@nflaig nflaig changed the title ci: set job status of e2e tests to passed if timeout is reached ci: set job status of e2e tests to passed after 15m timeout Oct 3, 2023
@nflaig nflaig merged commit 1d301bb into unstable Oct 3, 2023
21 checks passed
@nflaig nflaig deleted the nflaig/pass-e2e-after-timeout branch October 3, 2023 13:43
nflaig added a commit that referenced this pull request Oct 5, 2023
@nflaig
Revert "ci: set job status of e2e tests to passed after 15m timeout (#…
8738eae 
…6017)"

This reverts commit 1d301bb.
@nazarhussain nazarhussain mentioned this pull request Oct 10, 2023
Merged
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.12.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nazarhussain nazarhussain nazarhussain approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Intermittent Sim and e2e Test Stalls and/or Failures
3 participants
@nflaig @wemeetagain @nazarhussain